PATTERN GENERATION PROBLEMS ARISING IN 
MULTIPLICATIVE INTEGER SYSTEMS 
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Abstract. This study investigates a multiplicative integer system using a 
method that was developed for studying pattern generation problems. The 
entropy and the Minkowski dimensions of general multiplicative systems can 
thus be computed. A multi-dimensional decoupled system is investigated in 
three main steps. (I) Identify the admissible lattices of the system; (II) com- 
pute the density of copies of admissible lattices of the same length, and (III) 
compute the number of admissible patterns on the admissible lattices. 

A coupled system can be decoupled by removing the multiplicative relation 
set and then performing procedures similar to those applied to a decoupled 
system . The admissible lattices are chosen to be the maximum graphs of dif- 
ferent degrees which are mutually independent. The entropy can be obtained 
after the remaining error term is shown to approach zero as the degree of the 
admissible lattice tends to infinity. 



1. Introduction 

Multiplicative integer systems have been intensively studied in recent years; see 
El HH [TTl [18] and the references therein. One of the main related issues is to 
compute Minkowski (box) dimension and Hausdorff dimension of such systems and 
to compare them. These two dimensions are equal in an additive shift. However, for 
most known examples of multiplicative integer system, they arc different. Since the 
computations of these two dimensions arc difficult, effective methods for computing 
these dimensions for general multiplicative systems must be develpoed. 

This investigation is motivated directly by the work of Kenyon et al. [14] . who 
utilized a variational method to obtain the results on 

(1.1) X° = {( Xl ,X2,x 3 , ■ ■ ■) S {0, 1} N I x k x 2k = for all k > l} , 
and also pointed out that the method fails for the system 

(1.2) X° 3 = {(x 1: x 2 ,x 3 , • ■ ■ ) £ {0, 1} N | x k x 2k x 3k = for all k > 1} . 

This work provides an approach to general multiplicative systems, including Ijl.ljl 
and ([L2]) . 

*The author would like to thank the National Science Council, R.O.C. (Contract No. NSC 100- 
2115-M-259-009-MY2) and the National Center for Theoretical Sciences for partially supporting 
this research. 

**The author would like to thank the National Science Council, R.O.C. and the ST Yau Center 
for partially supporting this research. 

^The author would like to thank the National Science Council, R.O.C. (Contract No. NSC 
98-2115-M-009) and the ST Yau Center for partially supporting this research. 
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This study emphasizes the computation of entropy h(X) of the multiplicative 
system X. The Minkowski dimension dim a/ (X) is given by 



(1.3) dim M (X) = ^HX), 

where N is the number of the symbols of system X. The results of Hausdorff 
dimensions will appear elsewhere. 

Previously, the authors studied pattern generation problems on multi-dimensional 
shifts (of finite type) and developed some efficient means of studying the generation 
of admissible patterns, and then computing the topological entropy (or spatial en- 
tropy) sseejnunninnHnniininiiniis]- This study shows that these methods 

can be used to study the " multi-dimensional or coupled systems of multiplicative 
integers", including X!] 3 . 

To illustrate our method, is investigated first. The topological entropy 

has been shown to be 



(1-4) h(X°) = '£- j ^loga k , 

k=l 

where au is a Fibonacci number with a\ = 2, a 2 = 3 and ak+i = a k + a&_i for 
all k > 2 [8]. The derivation of (|1.4[) is as follows. Denote by the (multiplicative) 
relation set M2 of the integers of 2-power, i.e., 



(1.5) M 2 = {1,2,4,8,16,32,...,2V-.}. 

Denote by the complementary index set X 2 of X° that contains all positive odd 
integers: 



(1.6) ! 2 = {neN I 2 | n} = {2k + 1}™ =0 . 
The set of all natural number N can now be rearranged into 

(1.7) N= [JiM 2 , 

where iM 2 = {i, 2i, 2 2 i, ■■■ , 2 n i, ■■■}. Clearly, 

(1.8) iM 2 n jM 2 = 



if i,j GI2 and i ^ j. More precisely, the right-hand side of (|1.7j) can be expressed 
as an N x N table, Table 1.1. 
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Table 1.1. 

For k > 1, let Zj~ be the blank lattice of k cells in Z , k > 1, as present in Fig 



1.1. 



Figure 1.1. 

Let Mk and iMk be the numbered lattices of the first k elements in M2 and in iM.2 
on the Zk, respectively. 
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Figure 1.2. 



Let 



(1.9) 



M{m) = {fceN I l<k<m}. 



be the set of natural numbers that are less than or equal to m. For each n > 1 and 
1 < i < 2" , let 



(1.10) 



k n (i) = max {k I i2 k < 2™} = log 2 



where [a^J is the largest integer that is less than or equal to x. 
Then, from Table 1.1, it is clear that 



(1-H) N(2 n )= |J iM kn{{] . 

iGl 2 ,l<i<2" 

For example, for n — 4, from Table 1.1, 
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(1.12) M{2 4 ) = M 5 U (3M 3 ) U (5M 2 ) U (7M 2 ) U (9M X ) U (llMi) U (13M X ) U (15M X ). 
In terms of blank lattices, the numbers in Af(2 4 ) lie on 

(1.13) one copy of one copy of Z%, two copies of Z 2 and 2 2 copies of 2a. 

The result of general J\f(2 n ) follows from the following proposition, which can be 
easily proven by mathematical induction. 

Proposition 1.1. For integers Q > 2 and n > 1, 

n-l 

(1.14) Q" = (n + 1) + n(Q - 2) + (Q - lf^fcQ"- 1 "*. 

fc=i 

In particular, 

71-1 

(1.15) 2 n = (n+l) + ^fc2"- 1 - fe . 

k=i 

Therefore, (| 1 . 1 5[) states that the numbers in M{2 n ) are spread out on blank 
lattices with one copy of Z n+ i and 2 n-1 ~ fc copies of 2Tfc, 1 < k < n — 1. In 
particular, setting n = 4 in (jl.151) yields (|1 . 13|) . 

Now, consider again system X° and the target formula (|1.4|) . For any m > 1, let 
X m be the set of all admissible m-sequences in XfJ: 

(1.16) 

X m = {(xi,X2,- ■ ■ ,x m ) £ {0,l} Zm I XfcX2fe = for all k > 1 and 2k < m} . 

Our purpose is to compute |X m |, which is the number of elements in (|1.16l) . The 
entropy /i(X°) follows from 

(1.17) h{X° 2 )= lim -log|X ro |. 

m— >oo m 

The constraint 

(1.18) x k x 2 k = 

in (|1.16[) is the admissible condition of golden-mean shift on Z 1 , and it states that 
symbol 1 is not allowed immediately to follow symbol 1. Then, the forbidden set 
on Z2 is {1 1 1 1 1}. The transition matrix 



(1.19) G 
Le Sfe be the set of all admissible patterns on Zfe with respect to (|1.19j) : then 



1 1 
1 



(1.20) |S fc |=o fc , 

which is the fc-th Fibonacci number. Since the constraint (|1.18[) applies to each 
1M2 independently for i 6 1%, 
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n-1 

(1.21) |X 2 ,H|S„ +1 |I]|S fc | 2 

k=l 

which implies 



(1-22) -log\X 2 n\ = -a n+1 +J2^k+I^ga k . 

k=l 

Hence (fTI)) follows easily from (|1.22|l . 

Clearly, (|1.14p of Proposition 11.11 also recovers the following results [8] . 

Theorem 1.2. For any Q >2, denote the multiplicative integers system 
(1.23) X° Q = {(x u x 2 ,---)e {0, 1} N | x k x Qk = /or aU fc > 1} , 



(1-24) h(X° Q ) = (Q - l) 2 Enfe+T lo S a ^ 

fc=i ^ 

Consideration of the above reveals the following three main parts of our study 
ofXg. 

(I) Identify the numbered lattice Mfc and the "admissible" blank lattice Z k 

from the given system; see Figs. 1.1 and 1.2. 
(II) Compute the numbers of copies of independent admissible lattices of the 

same length; see formulae (|1.14[) and (|1.15[) . 
(Ill) Determine the set of all admissible patterns which can be generated on 
Zk, and compute the number thereof 

Notably, step (III) in the study of X° is the classical one-dimensional pattern 
generation problem; see |16] , 

Based on the above observations, the rest of this paper will consider the following 
two classes of systems. 

(i) Multi-dimensional systems like 

(1.25) X° 3 = {{x!,X2,x 3 , ■ ■ •) e {0, 1} N | x k x 2k x 3k = for all k > 1} . 

(ii) One-dimensional coupled systems like 

(1.26) X* = {( Xl ,x 2 ,---) e E A I x k x 2k = for all k> 1}, 
i.e., 

(1.27) x£=xjjn£,i, 

where is a proper additive shift of finite type. 
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For the multi-dimensional coupled system like 

^3 = {(^1)^2, ■ • • ) 6 £U XkX 2 kX3k = for all k > 1} 

(1.28) 

= xg i3 nE Al 

which is more delicate, will be studied in the consecutive paper. 

After we completed our study of (i) and (ii) , we became aware of the announce- 
ment of the work of Peres et al. [T7j on (ll.25[) . These authors obtained the same 
results as ours for multi-dimensional system (i). Our methods for studying (i) dif- 
fer from theirs. Moreover, our methods can be applied to (ii). To illustrate these 
methods and also for completeness, our approach to (i) is presented as involving 
the three specified steps (I), (II) and (III). Later, a modification of these procedures 
enables us to study the coupled system. 

The rest of this paper is arranged as follows. Section 2 studies multi-dimensional 
systems. Section 3 studies coupled systems. 

2. MULTI-DIMENSIONAL SYSTEMS 

This section concerns multi-dimensional systems. For simplicity, X!] 3 is consid- 
ered first. Recall that 

(2.1) X° 3 = {(xi,x a ,X3,---) e {0,1} N | x k x 2k x 3k = for all k > 1} . 
Firstly, the admissible numbered and blank lattices, determined by the constraint 

(2.2) x k x 2 kX 3 k = 0, 

must be identified in X° 3 . 

Let M 2 3 be the set of the numbers that are multiples of 2-power and 3-power: 

(2.3) M 2 , 3 = |2 fc 3' | k,l > 0} . 

M2,3 can be expressed in the first quadrant of the plane, as follows. 
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M 2j3 
Table 2.1. 

Since Mt2,3 inherits the natural ordering of natural numbers, the fc-th number in 
M2,3 can be denoted by q k , k e N. It seems that no known formula relates 2 m 3™ 
to 9, explicitly [19] . 

From Table 2.1, for any k > 1, the L-shaped fc-cell numbered lattice M k that 
contains {91,92,- •• ,9fe} can be defined, and fc-cell blank lattice L k can also be 
defined by deleting the numbers of M k . Table 2.2 presents the first 15 numbered 
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lattices Mfe. Notably, the number q k in the bold square is the largest number in 
M k . 
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Table 2.2. 

In contrast to X°, all lattices M^ and Lfe are now two-dimensional. Therefore, the 
system X° 3 can be regarded as a two-dimensional system; see [3l l5l l6l l7l [15] . 

Now, the complementary index set 12,3 of X§ 3 is the set of all natural numbers 
that cannot be divided by two and three: 



£2,3 = {n e N | 2 f n and 3 { n} 
(2.4) = {6fc + 1, 6fc + 5}^ 

= {1, 5, 7, 11, 13, 17, 19, 23, 25, 29, • • • } . 

The set N of natural numbers can be rearranged into the first octant of three- 
dimensional space as 



(2.5) N= |J M 2 , 3 , 

and for i,j G Z2,3 with i ^ j, 



(2.6) 

see Fig. 2.1. 



iM 2 , 3 niM 2 , 3 = 0; 
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Figure 2.1. 

Therefore, for any n £ N, there exists a unique i — i(n) such that n e iM^. 
Next, proceed to step (II): compute the numbers of copies of Mk for a given 
Af(m), defined in (fL9l) . 
Let 

(2.7) q K = 2 m T e M 2 , 3 

for some K > 1. Denote by 



(2.8) 
Define 



J K = {i£ ^2,3 I 1 < i < qx} ■ 



(2.9) 



q K (i) = max{g £ M 2 , 3 | «g < <7if } ; 



then qx{i) > 1 for any i G J/f. 
Denote by the set 

(2.10) I K {k) = {ieJ K I gjc(*) = A;} 

for 1 < k < K. Clearly, if qi({i) = k, then 

iqk < qK < iqk+i- 

Therefore, a parallel result of (11.111) and (| 1 . 14[) is as follows. 



(2.11) 

with 
(2.12) 



■Affatf) = |J iM qic(i) = [j iM k 
ie,J K iei K (k) 



t n\ i qK qK 
\qt+i qk 



2,3- 



The following example illustrates (|2.1ip and (|2.12l) . 
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Example 2.1. For qu — 36, it is easy to verify 

' Ji 4 (l) = {19,23,25,29,31,35} 

J u (2) = {13, 17} 

^ / M (3) = {11}, J 14 (4) = {7}, J 14 (5) = {5}, J 14 (14) = {1}. 
The others are empty. Therefore, 

7V(36) = M u U 5M 5 U 7Af 4 U 11M 3 U 13M 2 U 17Af 2 U iM x . 

ie{19,23,25,29,31,35} 

For 1 < k < K , denote by 



(2.13) a K (k) = \I K (k)\, 

the number of copies of M k in Af(qic)- 

Formula (|2.12[) gives the density of copies of M k in [l,qx], which is crucial in 
computing the entropy. Indeed, following proposition is offered. 

Proposition 2.2. OnX^, for an k > 1, 



1 



r aK ^ R ( l 
hm = [3 2 ,z 

K^oo q K \q k q k+1 

H^ 3 n[i,[2,3]]} l 

P2,3 = 



(2.14) 

where 

(2-15) ^, a - [2j3] - g , 

and [2,3] — 6 is the least common multiple of 2 and 3. 



Proof. For any hxed k > 1, from (|2~T2]) and (|2TT3]) . follows. Clearly, flUTg) 

follows from (12^41 . □ 



It remains to show that limit (12.14)) exists not only for qK but for all n tends to 
infinity. More precisely, for any 1 < I S 22,3) denote by 

' Mk,i = {n e N | 1 < n < Zg^} , 
Jk,z = {i£ £2,3 I « < ^ic} , 
(2.16) { q K .i(i) = max{<7 E M 2 , 3 | iq < Iqk} , 

lK,i(k) = Jk.i I QK,i{i) = k} and 
a K j(k) = \I K ,i(k)\. 

The following proposition can be easily verified. The detailed proof is omitted. 
Proposition 2.3. For k > 1, 



(2.17) 



where /3 2 ,3 is given fey 12. 15]) . 



% gfe+i 
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After the density of M& (|2.14p is obtained, step (II) is completed. Now, the final 
step (III) is to compute the admissible patterns on Lk for all /c > 1. 

Previously, two-dimensional pattern generation problems on L-shaped lattices 
has been studied by Lin and Yang in [15]. The constraint (|2.2p implies that the 
forbidden local patterns on L3 are 

(2.18) J-2,3 = 



Therefore, the basic set of admissible patterns is 




(2.19) S 3 = S 2 , 3 = 








1 









1 









1 












IT] 










TJ 





TJ 


1 


TJ 


1 


TJ 


1 


1 



see [5]. 

Clearly, Si = { 0, H } and £ 2 = { 







1 



10 



1 1 



}. 



and 



no constraint applies on L\ and L 2 . For fc > 4, Lj, can be regarded as the union of 
L 2 and L3, and the imposed constraint only applies on L3 parts. Hence, for k > 4, 
the admissible patterns on Lfc are completely determined by 82,3- 

After the above procedures have been completed, the following result concerning 
the entropy /i(X" 3 ) is obtained. 



Theorem 2.4. The entropy 0/X23 is given by 

00 

(2.20) h(xy = 



fc=i 



1 



1 



log|Efc|, 



,9fc qk+i, 

where is the number of all admissible patterns determined by 82,3 ■ 
Proof. The proof follows from Propositions 2.2 and 2.3. 

Denote by 

(2.21) E fe = £ fe (£ 2 , 3 ) 

the set of all admissible patterns that are determined by 82,3- Denote by 



□ 



(2.22) |S fe |=6 fe 

the number of patterns in E^,. Since no exact formula relates 2 m 3™ to % for M 2 3 
in Table 2.1, unlike for a Fibonacci number, no "recursive" formula exists for bk- 
This fact creates the most difficulty in computing entropy for a multi-dimensional 
system; see[l H [IS]. 

However, for relatively small k, b^ can be computed. Table 2.3 presents cases 
for k e [1, 14] and k with qi~+i — 6 l , 1 < I < 8. Clearly, q 5 = 6, qi4 — 6 2 , q 2 6 = 6 3 , 
<Z43 = 6 4 , Q64 = 6 5 , f/89 = 6 6 , qng — 6 7 , (7153 = 6 8 . Remark 2.5 concerns a further 
property of bk- 
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6 63 « 5.291646495998910 x 10 ib 


6 88 » 2.006283543836154 x 10 2a 


bus w 1.439075072036499 x 10 ai 


6i 52 « 1.022234008604671 x 10 4U 



Table 2.3. 

In Table 2.3, 6fc has been computed explicitly up to k = 152 by using the tran- 
sition matrices developed in [5J |B] . 

Remark 2.5. Define the ratio of |£fc| by 

(2.23) r fc = |S fc |/|S fc _i| = 6fc/6jt-i 

for k > 2. From Tables 2.1, 2.2 and 2.3, it is easy to verify that 



(2.24) 
for some n > 1. 



r fc = 2 «/ <? fe =2™, 



On ifte other hand, it can be shown that there exists C < || suc/i t/iat 



(2.25) 



r fc < C for q k ^ 2" for all n>2. 



Therefore, {rfc} cannot have a limit as k tends to oo, unlike the Fibonacci sequence, 
which has the limit 1+ 2 ■ A detailed study of {rfc} and bk will appear elsewhere. 

In the following, an approximation of (|2.20|) is given. For n > 1, let 



(2.26) 



^2,3 



= i>> a (I 



/c=i 



<7fc 9fc+i 



log|Sfc| 



Clearly, from Theorem 2.4, h^(K\ 3 ) is a lower bound of h{X^ 3 ), and /i (n) ( X 2,3) 
increasingly approaches /i(X;j 3 ) as n tends to infinity. Furthermore, let 



fc=n+l 



(2.27) 



n+1 



= /32,3log2(^±L + 3-E^), 



fc=i 



where V — = 3. Hence, 



fc=l 



(2.28) hQS° t3 )-hMQ% t3 )<EW(X°j). 
Table 2.4 presents cases for n with q n +i — 6 l and 1 < I < 
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n 


4 


13 


25 


42 




0.319901 


0.537229 


0.620707 


0.645733 
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88 


118 


152 


0.652284 


0.653865 


0.654224 


0.654303 



Table 2.4. 

Moreover, (X§ 3 ) w 0.0000238741. 

The theorem just established can be easily extended to general multiplicative 
systems. For completeness, the result is simply stated and necessary modifications 
to its proof are only sketched. 

Consider any two natural numbers 71 < 72 such that 72 is not a pure power of 

71 : 



(2.29) 72 + 1? 
for all m > 1. Let 

(2.30) x 7l:72 = {(xi,x 2 ,x 3 , • • •) G {0, 1} N I x k x llk x 12k = for all k > 1} . 
Denote by 

M 71 . 72 = { 7 r72 n I m,n>0} 

(2.31) 

= {91,92,93, • • • } > 
on the first quadrant on the plane as Tables 1.1 and 2.1, where 

(2-32) q k = q k (71,72) . 

Then, the numbered lattice M k — -^(71,72) and the blank lattice L k — ^^(71,72) 
can be obtained from (|2.3ip for k > 1. 
The complementary index set 

(2.33) Xy 1>72 = {n e N | 71 { n and 72 { n} . 
Then 

(2.34) N= |J iM 7l , T2 . 

Let Sfc(7i,72) be the set of admissible patterns on L k . Then, the entropy of 
XIl 72 is given by the following theorem. 

Theorem 2.6. For any two integer numbers 72 > 71 > 1 with 72 7^ 7™ /or aZ^ 
m > 1. Then, 



(2.35) /i(X^ 72 )=5j3 71i72 ( 1- J_) log |S fe ( 7l , 72 )|, 

t~i \ qk qk+1 
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whe 



( na\ a _ H {^1,72 H [1, [71, 72]]} 

where [71,72] is the least common multiple of 71 and^- 

The following example illustrates Theorem 2.8. 
Example 2.7. Consider 5 . Then 
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8 


16 


32 


9i 


92 


93 


95 


97 


9io 



iW 2 ,5 

Table 2.5. 

Notably, starting from k > 5, all Lk in differ from those in 

Xrj j5 have different sequences of admissible blank lattices, affecting £^(71, 72). For 
example, 



2,3, so X° 3 and 



Mi M 2 



A/3 



1 2 



Ma 



M, 



5 


10 




1 


2 4 


8 



M fi 



Table 2.6. 

Table 2.7 presents cases for n with q n +i — 10 and 1 < 2 < 7. Clearly, gg = 10, 
915 = 10 2 , 929 = 10 3 , 948 = 10 4 , 972 - 10 5 , 9100 = 10 6 , 9134 = 10 7 . 



n 


|E n (2,5)| 




5 


25 


0.431341 


u 


7,^0,2 


0.616889 


28 


38,739,020 


0.660010 


V 


4,446,117,963,472 


0.667813 


71 


« 8.805722546306860 x 10 iB 


0.669042 


99 


w 1.961346392265600 x 10 2B 


0.669220 


133 


w 1.685495616218491 x 10 35 


0.669244 



Table 2.7. 

Moreover, £( 133 ) (X^ 5 ) » 0.0000259978. 
On the other hand, if 



(2.37) 



71 = Q and 72 



where Q > 2 and m > 2, then Xq g m is reduced to a one-dimensional problem and 
the following result is obtained. 
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Theorem 2.8. For Q, m > 2, ifji=Q and 72 = Q m , then 



(2.38) h(X° QiQm ) = (Q-l) 2 J2 75l+Tlog|a fc (Q,Q m )l, 

fe=i w 

where — \A(Q,Q m )\ for k > m, aj = Q j , 1 < j < m, where A(Q,Q m ) is the 
associated transition matrix of B(Q,Q m ). 

The following two examples illustrate Theorem 2.8. 

Example 2.9. First, consider Xj 4 . Steps (I) and (II) are the same as for XJj. In 
step (III), the forbidden set o/£fc(2,4) is {1 1 1 1 1 1 1}. The associated transition matrix 


1 





4(2,4) = 



(2.39) 



\m\ MB urn 



nm 



1 

1 

1 







1 



Therefore, as in 



(2-40) /l (x« 4 )=^^ TT loga fe (2,4), 

k=l 

where ai(2, 4) = 2, 02(2, 4) = 4 and (2,4) = |A(2,4) fc - 2 | for all k>3, where \A\ 
is the sum of all entries in A. 

Next, consider X§ 8 . Now, the forbidden set o/£ fe (2,8) is {l 1 1 1 1 ° l ' l,Lil ' I ' I M }. 
Hence, the associated transition matrix 

mm 



1 





Therefore, 

00 

MX^, 8 )-^^ TT loga fe (2,8), 

k=l 

where oi(2,8) = 2, a 2 (2,8) = 4, a 3 (2,8) = 8 and a fc (2,8) = |A(2,8) fc ~ 3 | for all 
k > 4. 

Now, the study of higher-dimensional systems is briefly described. The methods 
employed and results obtained for two-dimensional cases can easily be extended to 
higher-dimensional cases. Only the necessary modifications are sketched. 

Let 



mw mm imii mm mm mm miii 



A(2, 



r°TnT°1 

mm 
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(2.41) 1 < 71 < 72 < • ' ' < 7d 

be natural numbers, d > 3, such that jj is not pure power ol 7, for all i < j, i.e., 

(2-42) 7j + 7™, 

for all m > 2 and 1 < i < j < d. 
Denote by 

(2.43) r = r d = (7 1 , 72 ,.-. , 7d ) 

and 
(2.44) 

= {(x 1 ,x 2 ,x 3 ,- ■ ■) S {0, 1} N I x k x llk x l2k ---x ldk =0 for all fc > l} 
Denote by 

M r ^ { 7 r72 i2 ---7r I ^i>0} 

(2-45) 

= felfci 

with gfc < if fc < j. 

Then, (|2.45p dehnes a sequence of d-dimensional numbered lattices of k cells. 
The blank lattices L k are defined analogously. The complementary index set Zr of 
Mr is defined by 

(2.46) 1 T = {n e N | jj \ n, 1 < j < d} . 
Hence, 

(2.47) N = (J iMr - 

ielr 

The constraint 

(2.48) Xf z x^ 1 f £ x^ 2 f t • • • x*y d k 

determines the set Br of basic admissible patterns which induces a ei-dimcnsional 
shift of finite type £(£>r) on the d-dimensional lattice space Z d . Therefore, the 
admissible set Efc(Br) is completely determined by Br on 

Now, by a similar argument, the entropy of X r is easily obtained as follows. The 
detailed proof is omitted. 

Theorem 2.10. Let V = {71,72, ••• ,7<z} satisfy WV§ and W4^ - Then the 
entropy o/X r is given by 

00 / 1 1 \ 

(2.49) / l (X r )=V^ r log|E fc |, 



fc=i 



9fe <Zfc+i 
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whe 



(2.50) 



A- 



1 T n [1, [71,72, • • • ,7d]] 



[71:72, ' ■ ■ ,Jd] 

and [71,72, •• • , 7d] is the least common multiple 0/71,72, • • • ,"fd- 

The following three-dimensional system illustrates the methods and results. 

Example 2.11. For d = 3, consider 

X 2,3,5 = { (£1,2:2, £3, • ■ ' ) € {0, 1} N I x k x 2 kX3kX 5 k = /or a// fc > 1} . 
Then, 

3" 

A 




12,3,5 

Ta&Ze «.S 

TTie first six numbered lattices are listed as follows. 



Mi 



/ / / 


1 


A) 



1 2 



P 



M 2 



M 3 



M 4 



2 4 



/ / 


/ 




3 


6 






k 







M 5 



Mr 



Ta&Ze 2.5 



Clearly, 



22,3,5 = {30/c + j |je {1, 7, 11, 13, 17, 19, 23, 29} and fc > 0} . 
Therefore, it can be verified that 



(2.51) 



fc=l 



log|E fc (2,3,5)| 



v 3fc 9/c+i, 

where 02,3,5 = ^ and ffte forbidden set o/£fc(2,3, 5) is 4jK 
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The n-th order approximation of 12. 51\) is as follows. For n > 1, let 

^ \qk qk+ij 

In Table 2.10, |E„(2,3,5)|, 1 < n < 25, is listed. 



n 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


|E»(2,3,5)| 


2 


4 


8 


16 


30 


60 


120 


240 


452 


904 


1708 



12 


13 


14 


15 


16 


17 


18 


19 


34 16 


6832 


12860 


25720 


48720 


97440 


1 84704 


369408 



20 


21 


22 


23 


24 


25 


738816 


1390768 


2625128 


5250256 


9979776 


19959552 



Table 2.10. 

Moreover, /i (25) (X§ )3i5 ) w 0.548837. 

The constraint (|2.48p is not essential and can be generalized. Therefore, the 
study of system X r can also be generalized. In the following, the procedures are 
sketched below. 

For any N > 2, consider a multiplicative system is of iV-symbols, {0, 1, 2, • • • , iV— 
1}. For any d > 1, let the constraint set C be a subset of {0, 1, • ■ ■ , (N — l) d }. 
Denote by Xr(iV, C) the multiplicative integer system with constraint set C: 

(2.52) 

X r (iV, C) = {(xi,x 2 ,x 3 , ■ ■ •) € {0, 1, • • • , N - 1} N I x k x llk x l2k ■ ■ ■ x ldk £ C for all k > l} 

which consists of TV-symbols, {0, 1, 2, • • • , N — 1}. 
The following theorem can be easily obtained. 

Theorem 2.12. Let T = {71,72,- •• ,7^} satisfy [2~Jl\ )~ (2~4~3\ ) andC C {0, 1, • • • , (N - 1 

The entropy o/Xr(iV, C) is given by 

00 / 1 1 \ 
(2.53) h(X T (N,C)) = Y^Pr log \Z k (B r (N,C))\, 

\qk qk+ij 

where T,k(Br(N,C)) is the set of d— dimensional admissible local patterns that can 
be generated by Br{N,C) on L k . 

The following example illustrates Theorem 2.12. 

Example 2.13. Let N = 3 and C = {0, 2}. Then 

X 2 (3,C) = {(x 1 ,x 2 ,x 3 ,---)€ {0, 1, 2} N I x k x 2k € {0, 2} for all k > 1} . 
The basic set of admissible local patterns is now given by 

# 2 (3,c) = {H3, nm, ma, ma, ma, rua, mn}. 

The associated transition matrix is 
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m 

A(2;3,C)= m 

e 

Therefore, as in Theorem 1.2, 



m m E 

1 1 1 

1 1 

1 1 



h(X 2 (3,C))=4 5^g Efr logo fc (2;3,C), 



fe=i 



w/iere oi(2;3,C) = 3, a fc (2;3,C) = A(2;3,C) fe - 1 /or a// k>2. 



The system (|2.52p with 7,- = 7™, i < j, for some m > 2 can also be studied. 
Detailed results are omitted. 

3. Coupled systems 

This section considers the coupled system, which is an intersection of the multi- 
plicative integer systems Xq with an additive proper subshift of finite type E^, 

(3.1) X$=X°nE A . 

A simple system is considered first; the findings are then extended to general 
systems. Consider 

(3.2) 

x£ = x° n y*a 

= {(xi,X2,X3, • ■ ■ ) <E {0, 1} N I x k x 2 k = for all k > 1 and (xi,x 2 ,x 3 , ■■■) £ XU} 



where 
(3.3) 



A = G = 



1 1 
1 



induces the golden-mean shift E^ with positive entropy /i(E^) = log ( 1+ 2 V ^ ^ ■ 
To incorporate the effect of E^, Table 1.1 is replaced by the following table. 




Table 3.1. 

As in Table 1.1, the horizontal lines in Table 3.1 connect the integers in 1M2 for 
each i £ I2, the effect comes from X°. On the other hand, the bold zigzag line in 
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Table 3.1 connects all natural integers comes from E^. Therefore, for any i ^ j in 
I2, M2 and jM.2 are no longer mutually independent. In fact, they are all coupled 
through the relation set M2. Therefore, (I3.2[) is regarded as a coupled system. 
Before the system X^ 1 is decoupled, the following definition is needed. 

Definition 3.1. Two sets of integers of M and M' are mutually independent in 

^ if 

(3.4) M n M' = 

and any numbers m in M and ml in M' are not consecutive and m and ml are not 
consecutive in 2-power, i.e., if m = 2 n for some n then m! =^ 2 n+1 and 2"~ 1 . 

In this case, M and M' are decoupled in X^ 1 . The following lemma is easily 
obtained. 

Lemma 3.2. Suppose M and M' are mutually independent in X^. Then 

(3.5) |E(M U M')\ = |E(M)||E(M')|, 

where E(JVf) is the set of all admissible patterns on lattice M, and E(M') and 
E(Af U M') are defined analogously. 

The strategy for studying (|3.2[) is to decouple the whole system into disjoint 
pieces by eliminating M 2 , such that only 




is considered. From the reduced system X^, a sequence {X^(m)| of indepen- 
dent branches are chosen. Then, the entropy of the decoupled independent system 
X^ (to) can be computed easily. An appropriate choice of X^ (to) is demonstrated 
to enable the recovery of the entropy of Xf, i.e., 



(3.7) lim hCK£(m)) = h(Xi). 

m— f 00 

As in decoupled system X°, the admissible numbered lattice Mk in X^ is firstly 
picked up. Indeed, Mk is determined as follows. 
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(f) M 4 (3) 



Figure 3.1. 

Notably, M m (l) and M m (V) are mutually independent when 1,1' £ X 2 and |/ — 
l'\>2 m+1 . 

Consider in more detail the construction of Mk, which is recursive and robotic. 
The basic concept is that any number can produce the next generation through 
X 2 or E^. More precisely, for each number n, if n G Z 2 , then n can produce the 
next generation 2n £ nM 2 . If n £ Z 2 with n = i2 m , m > 1, then n can produce 
2n = i2 m+1 e iM 2 through X 2 and n ± 1 = i2 m ± 1 € X 2 through E A . A complete 
production cycle is as follows. If n G I 2 , then n produces 2n and then 2n ± 1. If 
n = i2 m , m > 1, then n produces i2 m+1 and then i2 rn+1 ± 1. 

For example, for Mi (3), only one cell exists, and number three is regarded as the 
number of first generation. M 2 is constructed from M\ by extending the number 
three in first generation to the number six in the second generation through 3M 2 , 
and then taking six in the first generation to create numbers five and seven as the 
descendanta of six through £4. In the horizontal direction, M 2 has two cells that 
are numbered "3" and "6". M 2 is called of degree 2. 

The construction of M 3 form M 2 is performed similarly: the number six yields 
the third-generation number 12 in M 2 . Simultaneously, numbers five and seven 
yield the second-generation numbers ten and 14 in M 2 , respectively. Next, numbers 
ten, 14 and 12 yield their descendants nine, 11, 13, 15 and 11, 13 through T,a, as 
presented in Fig 3.1 (d). The maximal number of numbers of cells in the horizontal 
direction is now three, and M3 is therefore now of degree 3. On Mk, the maximal 
number of numbers of cells in the horizontal direction is k, and Mk is of degree k. 
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M 2 (3) 



A/2 (9) 



Figure 3.2. 

After the basic lattices and are identified, in a given range Af(2 n ), step 
(II), which is the computation of the number of disjoint copies of Mfe(Z) C with 
I G Z 2 , is implemented. Back to Table 3.1, [1,32] can be decoupled by M2(3), 
M 2 (9), M 2 (ll), M 2 (13), M 2 (15) and {1, 2, 4, 8, 10, 12, 14, 16, 20, 24, 28, 32} are not 
used; see Fig 3.3. 



19 ' 
IT / 

EH- -\- h - - 
□ 

M \/ 22 

on is 

7 © © 

5 / © © 
m — -/ © © 
0© © © © © 

Figure 3.3. 

There exist one copy M 2 (3) in (2,2 3 ) and four copies M 2 (9), M 2 (ll), M 2 (13), 
M 2 (15) in (2 3 ,2 5 ). Notably, [1,2 5 ] \M 2 = M 4 (3). However, Fig 3.3 enables us to 
approximate entropy by using M 2 alone under the expense of losing numbers which 
are relatively small compared with the numbers that have been used. 

Furthermore, the following observations are made and are very useful in studying 
M 2 and M 3 . In Fig 3.4, between (2"~ 2 , 2"), each odd integer I G (2"- 2 , 2"- 1 ) nl 2 
can produce a M 2 (i) that lies in (2 n_2 ,2 n ). Furthermore, they are all disjoint. 
Therefore, there are totally 2 n ~ 3 copies of M 2 . Similarly, as in Fig 3.5, between 
(2"- 3 ,2 n ), each I 6 (2™- 3 ,2"- 2 ) nl 2 produces a M 3 {1) that lies in (2™- 3 ,2"). 
They are all disjoint. The total number of copies of M 3 (l) in (2"- 3 ,2") is 2™~ 4 . 
Therefore, the following conclusion is drawn. 




2 n-i 2 



c 



2 ™-5 2" 



2 n-3 2 „-2 2 „-l 2 " 



Figure 3.4. 



Figure 3.5. 
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Lemma 3.3. For any k > 1, if n > (m + l)fc + 1, within (1, 2 n ), there are 

(3.8) a n (k) ^"-^(l + l + ^ + .-. + ^I 

disjoint copies of Mk(l) with I G X2. 

Finally, for step (III), denote by the admissible patterns on Lk- Then, Lemma 
3.3 yields the lower bound of the entropy hili^)- 

Lemma 3.4. For any k > 1, 

(3-9) 2{2 l_ i) log\Z k \<h{^). 

Now, a good upper estimate of the entropy ft(X^) remains to be found. As in 
the derivation of Lemma 3.3, only the number of the vertices that are not used 
in (|3-8[) and their contribution to entropy have to be determined. The following 
lemma is easily obtained. 

Lemma 3.5. For each k > 1, the number of the vertices of Lk satisfies 

\L k \= fc + 2|L fe _i| 

(3.10) 

= 2(2 fe -l)-/c, 

and the number of 

(3.11) N(2 n )\\jM k {l) 



iei 2 



is 



(3-12) — -r r2™. 

1 ' 2(2 fe -l) 

Moreover, 

(3.13) h(X-) < Jog ^1 + ^*^1082, 
where is the number of all admissible patterns on L k . 

Proof. (|3.10[) is easily proved by induction. Then, (|3.11[> and p.!2p follow imme- 
diately. The details are omitted. 

Since two possible symbols "0" and "1" can be presented on vertices in (|3.11|) . 
the upper estimate (|3.13p of entropy follows. 

□ 

Lemmas 3.4 and 3.5 immediately yield the following result. 
Theorem 3.6. The entropy hCK^) is given by 

(3.14) h(X^ = Mm *_ log |E fc |. 
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Furthermore, 

(3.15) ^^ylogl^l < h(Xf) < ^^ylogl^l + log 2. 

Proof. (|3.14[) follows from (|3.15[) immediately. □ 
Table 3.2 presents a numerical approximation of (|3.15[) . For n > 1, let 

M")(X^)= ir)log|S„| and ft(™)(X^ = M")(Xf) + ^ TT log2. 



n 


2 


3 


4 




9 


237 


213624 




0.366204 


0.390576 


0.409066 




0.597253 


0.539107 


0.501485 



Table 3.2. 

Remark 3.7. Whether /i(X^) can be expressed in explicit form, as is for 
/i(XEJ) is unclear. 

Now, the result for X^ 1 is extended to 
(3.16) 

Xq = {(x 1 ,x 2 ,x 3 , ■ ■ ■ ) e {0, 1} N | XfeXQfe = for all fe > 1 and (xi,x 2 , •••) 6 £a} 

for any integer Q > 3. 

Recall the main parts of the investigation of the coupled system X^ and apply 
them to Xq . 

(I) c Remove Mq from N = (J iMg to decouple the system, yielding the re- 
duced system X^ = [j iM Q f| E A . 

Kielq 

(II)c Identify the lattice ( and Lfe), which is the maximal connected graph 
of degree k. All Mfc(Z), Z € Zq, are disjoint. 

(III) C Compute the remaining vertices in 

(3.17) M(Q n ) \ |J M k (l). 

(IV) C Compute the number of admissible patterns on Lj,. 

Step (II) C will give lower bound of H(Xq), and (III) C will give upper bound of 
h(Kg). Then, /i(Xq) follows if the error term in (III) C approaches zero as n tends 
to infinity. To minimize the error in (III) C , the amount of unused lattices should be 
as small as possible. Therefore, the choice of M k or the graph L). in (II) C should 
be as large as possible as far as they are decoupled. 

X^ can be used to illustrate the procedures of (I) C ,(II) C and (III) C . From 



(3.18) 



N = \JiM 3 , 

iei 3 
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the following figure is drawn, corresponding to Table 3.1 . 




Table 3.3. 

Take Mi as being on one vertex. In Fig 3.6, a maximal connected graph with 
two horizontal vertices in (J 1M.3 can be identified as follows. Notably, M2(4) 

Kiel 3 

and M2(7) are mutually independent. 



M 2 (4) M 2 (7) 
Figure 3.6. 

Furthermore, M3 can be constructed from M2 as follows. 



M 3 (4) 
Figure 3.7. 

The following result yields the vertices in Mk of Xq . 

Lemma 3.8. For any Q > 3 and k > 2, denote Lq.^ be the degree k blank lattice. 
The number \Lq.^\ of the vertices of Lq-^ is 



(3.19) 



lr . Q (Q k 1) , 
IAmI= q _ 1 -k. 
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Proof. The result is proven first for the case Q — 3. The other cases can be treated 
analogously. 
For Q = 3, let 

a 3,ri = 2-3™. 

The blank lattice can be obtained from M2(4) in Fig 3.5, and 

\L 3 -2\ = a-3,1 + («3,i + 03.2) = 10. 
Now, L3.3 is obtained from M 3 (4) in Fig 3.6 and can be grouped as follows. 




Figure 3.8. 
According to Fig 3.8, it is easy to see that 



3 ; 

1^3:3 1 = EE fl 3j 

z=ij=i 

= a 3: i + (a 3: i + a 3i2 ) + (03,1 + 03,2 + 03,3) 

= 1^2:21+26. 



By induction, it can be proven 



(3.20) 



|i 3i m| = |L 3;m _i|+3 m -l. 



Therefore, (j3~T§l) follows for Q = 3. 
For Q = 4, M 4j2 is as in Fig 3.9. 



M 4;2 

Figure 3.9. 

Similarly, for any Q > 4, Mq j2 is given in Fig 3.10. 
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C8 



c 6 

c 5 . -f 



2Q - 1 



2Q 2 - Q 



/ 



' + 3 



- 3Q 



/ 



> + 2 



Q + 2Q 



Q +Q 



c 1 = Q 2 + l, c 2 = Q 2 + Q-l, c 3 = Q 2 + Q + l, c 4 = Q 2 + 2Q-l, c 5 = Q 2 + Q + 1, 

c 6 = Q 2 + 3Q-l, c 7 = Q 2 +3Q + l, c 8 = 2Q 2 -Q-l, c 9 = 2Q 2 -Q + l, c 10 = 2Q 2 + 2Q - 1 

Figure 3.10. 

Define 

a Q , n = (Q-l)T-\ 
Careful mathematical induction proves (|3.19[) . The details are omitted here. 

□ 

Now, we can extend Theorem 3.6 to all Q > 3, as follows. 
Theorem 3.9. For any Q > 3 and k > 2, 

(3.21) logfel < h&) < (log|E g;fc | + fc log2), 



(^2) ^) = &g^i)^l^l. 

where Sg^ is i/ie sei o/ admissible patterns on Lq.^- 

Proof. It can be verified that the number of Mq.%{1), I <E Xq Pi [1, Q n ], is 

(3.23) Q ~ 1 



Q(Q fc -l) ' 
By (|3.19[) . the number of the remaining vertices in [1, Q n ] is 

(Q-l)k 

Q(Q k -iy 
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The results follow immediately. 

□ 

Like Theroem 2.12, Theorem 3.9 can be generalized to any number of symbols, 
any constraints C and any additive shifts of finite type Ha- Indeed, let 



(3.24) 

= {(£1,2:2, £3) • • • ) G {0, 1, • • • , N - 1} N I XkXQk G C for all k > 1 and (xi,x 2 ,x 3 , ■ ■ •) € Ea 

where C C |0, 1, • • • , (N — is a constraint set and A is an mxm — 1 matrix. 

Then, the following theorem can easily be obtained. The details of the proof are 
omitted. 

Theorem 3.10. For any Q > 3, C C {0, 1, • • • , (N - l) d } and k>2, 
(3.25) 

q(q^1) l0 S \^k(Q;A;N,C)\ < h m (N,C))< gfe^Tj (log \^k(Q;A; N,C)\ + k log N) , 
and 



(3.26) h (N, Cj) = Urn Q ^ Qk _ log |S fe (Q; A; N,C)\, 

where Sfc(Q; A;N, C) is the set of all admissible patterns on Lq-^, the constraint of 
the vertices on the bold lines in Lq.^ is given by A and the constraint of the vertices 
on thin lines in Lq-^ is given by N and C. 
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